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(54) VIDEO SIGNAL PROCESSING METHOD 

(57) Abstract 

PROBLEM TO BE SOLVED: To display the source video 
signals having a wide dynamic range at the display 
device having a low dynamic range with excellent 
contrast by extracting high frequency components by 
removing low frequency components from the source 
video signals and turning signals for which the low 
frequency components to which the prescribed weighting 
less than one is performed are added to the high 
frequency components to display signals. 

SOLUTION: A processor 38 computes the low frequency 
components LF. the high frequency components HF 
generated by removing the low frequency components LF, 
the conversion function IHS of the counted value of the 
frequency of a histogram and the conversion display 
signals DHF of the high frequency components HF 
converted by the conversion function IHS from the source 
video signals S from a camera 31 stored in a memory 32 
and stores them in the memory 34. Then, the conversion 
display signals DHF and the low frequency components 
LF weighted by a coefficient {3 are added and the display 
signals DP are generated and stored in the memory 33. 
Thus, the high frequency components HF are emphasized 



and video images v^rtth the improved 
displayed at the display device 37. 
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^3SSS:*i6SXei:. 

« * T-<^ ^ mmmm<r)m^m^ s ^mwm ^ * * 5 

Xgir. 

mTikm^^mz ^Wk-r 5 xe t . 



[»*^7i w*^2{c:fE«c<:o^ft«^t^Ma^ffi^c*5^^ 
ft^ifE^^&M^^**?)5xs^c*3^^r, -^n^'ttoft-^-s* 

9 1 1 *fcfi 2 (c|E4g<D?*^ff -f-^aa* 

[»*^1 O] 

40 m-§-^a§geo 

[m^mi 1 1 a^^si:. 

i^s^^ft-^Maast^^t^stvfc^^m^srfafit-rs*^ 

50 cDiij^roft^5i|gSr**T, ^KiiiI^O(SJlj!«c^^5J-(0 
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mmt^^m^^^i-^mmt. lo 

lO 0 0 1 ] 

^m^mmmmi-m-r^o 20 
[0002] 

Lr, ■Br«5tcD^-g-<i8 t-y h^^cop^m (2 5 61© 30 
m) \^t>^ti:\f\ LA^tx ii^roCRT«^SBt> 2 5 6 

[0 0 0 3] t^oT, *M(-5S^^;!7^7#t::J:t)^ttS 
10 0 0 41 ^:iX\ V^MA^h^mt^lCi^hA^ff^m^ 

co;^ffitt, h^7i>.7°ni;'cci?t^3 (HP) 

[0 0 0 51 l^^cTDt;^ hi/^A^^fiKL. 

^t-rstp^ h^^A^ffi (HE) ^-SCfcfcS, HJc:. 50 
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±15 1;^ h;/^ v^zc^ V'g t ^ 

^<ffi*^t©SfS*^T'fc57'7 h'i'^ffi (PE) 

[0 0 0 6] ±fE(^#;^5S:tt, 0iJ;t(i. t'T-f 
2 0 2 0 -O'P'^ 1^3/ K • X^'/Dv'X I X (1 9 9 
3) 4 4 0~4 5 OM (S P I E Vol. 2 0 2 0 
Infrared Technology XIX (1 
9 9 3) p p 4 4 0- 4 5 0) IC|Ett^4xTU''5, 

[0 0 0 7] z.f\.h(r>:)3^\t.^ v^-r4^t>y-r•:^5 s'^ w 

[0 0 0 8] 

[0 0 0 9] ^rT% *:^0J<Dg6^](d;, *^^;<7p<7^ 

[00 10] MtC, *:^e^<DSWJ*, i.i)WWiTf\^^ 
[0 0 11] sE{c, ;4s:BPJoa6t)f±. ^>!r ''iSfc^liim 
[0012] 

[^j@^fi?^1-5fc«)<7)^S] ±f5wae^{4, 
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[0 0 131 H»r, ±KcOB6<jf*. 2^%§gicj;ttfi. IS 

mm^m^ic^^^^x. mmmm\cm^^m^-i-?>x.m.t 20 
[0 0 14] ^fzs ±m<oif(:mn^mm:^mt:mm-r^ 

[0 0 15] 

V\ 30 

^-r^^ym<Dmxi)h. WM^it^ 1 0 (D'^mm^m 
{ci±, ^itia ot?;^Lfcai5. mm{tLm.^^n\^x\t^\y 

[0 0 16] Wi&LfciifJ. ft(S<^{t-S-U"</V'Srft{£<iO 

T- # 6 Jt'»t«fiS Oi« V ^B*^m^ u-</u{c:SiJ S T S fc' 

[0017] ;!^^Bjr-f±, m 1 {r^Lytffij^^^^^^^r 
^m^(ntmmWimp^<oMmmm^^i:m^\.xumm so 
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-§-Sr:t^ L J; 5 i: -r S © T-fc So 
[00 18] Mid. *^e^T-(i. ^co^m^^fiSL^oyi 

[0 0 19] J!^i*»{t^(^^FBi;ij^^;5g^d^6>{g;j^&^ 

[0 0 2 0] iii2t±, wMmt^<r)^mm^^ii^hmQ^ 

\^ti^mW.M^(n>\i:^Vi^=7J>^u (s) hp (t 

H P :fe-^St;5H E ^-iCT-* t> h Lfc^©* V h ffiiS: 

[0 0 2 1] *-r, 0 (s) ii^l^mf&^f^^n 

t;^ h^^AT-fcSo gp*>, lill{C;T%$tl-5ii<9> J^l* 

[00 2 2] ^-rr-, r(Ot;^h^7AH (s) 

T. ^{t-f-^-i/i'-Cl oc>iiF^T-t#^E-rs^'a-f4 1 

^<>>h-r^HP^^{:i'^':>xm^^^'y>'h-r^t. 
m'pHsx'^^ti^m'omimm<Dmmtfj:i>o ^(om 

T-(4, t;«.h:i^9-^H (s) *sfe;&(cft<x— yu^§|v> 
100 2 3] t^hi/7AH (s) (Cl^rUT. m 

w^^^m^i^^/^a^mm^ (.mm s:*o-h m-^) 

■r^HE:^^\C'^'z>xmA^:^'>>h-t?>t. El* 1 H 

SX^^ti^m'om^^::^ hi^yJ^H (s) ^m-^i^fc 

[0 0 2 4] ^ZX\ rttb<^)M»HS^fc(4 I HS5r 
^t&BS^i LT, S Lm i n^J^f^S Lma x^r-cDU-:/ 
i^JcfoSft-^-I^^/USTlS, 0*>e>DLma x^t?W^> 

s 1«. ^^^tl^t^tl'eihdl^tcHd2com7r^l- 
^/i-ir/iSo HP;fe-S:-e{±#^Ei-Si*ftft#U'^>'Wc:*f 
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[0 0 2 5] mm\^HP:^^<Dmm 

t;O5^J0^L7to ^(DM^it. ^m^(D^i^ 

AH (s) T*S>oTfc;fe;&lc«<7^-/i-^?|<fci6. m 

ma X ^T'ai-^;^^bT*fcf9 . ft.^tT):^-^ 2 (Smax 10 
-Smin) {zm-t^o ^:lX\ HE;^5^(;it^oTh:><. 

[0 0 2 6] III3*i. ±IEC0^^^^ttfc^^U-</Ut-^ 

6 1 i-^McML^xm&^^m^^-\^t^^o CO r 

[0027] 1114. 5. 6, Tia-X^ -Wit\^Xm^m. 

(13 4) . mm^mf^^Atini^-:>\^^x^^^^fcm7jku 
^/i^xm^j^i^fcmm (0 5) . ^co^^^^ix/cj^j^jsm 

xumi^fcm:^ (me) . i&mi&m^^<o^^m7jk{^fz. 

^» (I1I7) ^##{c:.i^-t-o 

[0 0 2 8] i^K^(7)^J (0 4) (Clte^UT. 
f^^m-fiom (HIS) (^fa5;^>:=^> h^;^ h:d^i^< <9 30 

55^^i^ilKi5:^5>{c;tjP;t5::<Jr-Tr (He) (0$d<®So 

[0 0 2 9] ii8fi. WMi&it^-<D^mmi^m:^^^iAa\ 

b/hi^i^&^^^J't^t:^ h^^^'^AH (s) PE (:r 40 

^ h ^ma) ^mmmm. i h s ^^-r^^^ ym 

(omx^^o ::i<omxh. HS (s) i!}mm^^f&^<D 

yi^x(Dmst(omMj^^^wi^(Dimc]^x. ^n&.±.(Dm 
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[0 0 3 0] SfoT. M^^V^yJ^U (s) (:ot:'->:^ft 
[0 0 3 1 ] :i(OiSil2fim^^tcov>T^^ 

E (tJ^hi/^A^ffi) N=M {M\t2&< 

Aicomm o^^flPE (r/^h-^^ffi) :}j^\z.t^^^ 

MiCN= 1 <7:»:^^(iHP (t ^ AT'CT v^zn:?' v-a 

[0 0 3 2] ®- 

T. ^g:i^^s«sc^^{cl*^<o^sv^s;9^-^{t^s^i3^«^ 
^mi&^fSL^n F jp^-r s r i: ^m^i!m<om^ 

t-r^o fiP^^. ^:a^ft-§-DPfijJccoa«9T-fc6o 
[0 0 3 3] S=HF + LF 
D P = HF + i3 LF 

(i. ^:^m-^DPfi2fcCOiiOT-fo'5o 

[0034] S=HF+LF+MF 
DP = HF+ /3 LF + yMF 

^ft^U'-<^i-^*7r:m'§-l^-</^DHF{c^^-r5o 

(j. k) (om7v^\t%DP (j. k) Sr*Jt>^S5#S:i;i 

[00 3 5] H F (j, k) = S (j, k) - L F ( j, k) 
DHF(j,k) =DLmax * I HS (H F (j, k) ) / I H 
S ( S Lmax ) 

DP(j,k) = (l-i3) *DHF(j. k) +i3LF(j, k) 
f^. |gl3*fc(^lll8(C;^^tt53ai9. DLmax {t^i^m 
7r^U-<;\^^ S Lmax \tWi^(r>\t^U^;V(D^±\^Xh 
t^oTIHS (SLraax) fl. ^t^Mm^^*:^^^ 

[0 0 3 6] ^HO^t#«lSfi. JifS^ZK^ft-f- 

[0 0 3 7] 

[«ll 
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^LT. 1119, 10, 11, 1 2{C±W.m\^7jk\_^tll 
m (a) , (b) , (c) , (d) ^Tjk-to -h!B«<?5# 

4) T-fc^o S#4fi. b;^ h>/^Acr):>?7e7>^ h 

loo 3 8] #-^2f^. *:;^^«iSNS:2tA±OS#C^ L 
0!lT?$)5o HI 0tc:fi/3= 1/4CO#^COB^^ (b) . 

mi 1 \at 0 = I y 2 (om^(Dm^m (c) ;5^^tt^'tL 

to 0 3 9] ^LT. S-^Ki. ft:^«SN^l t l^tz 

lai 2(Cfi#{C/3= ICO^-^COe^^fiTtJ (d) 

[0 0 4 0] WJi(^a'9. f^j^&^^^^fit ;^ h^^^A 40 
(Dti^l^ hM« I H S fc J; a^tfe^iXT^c^^^^ 

[004 1] SYc. ft:^^M*N=l ^t-r-St. HtjiliUfc 
ii 19 EI 3 COH S c;0$P < ^ tb^c^ V <^ [B]^ ^ 9 . 

[00 4 2] \.^mB%^m&m m i 3 1*. ±iB<^e* 50 



# :/ a ^ ^ p»S0 R O M/i)5 :;?7 j;^ -7 

m^iia. 7«^y 3 9{c*&*fl$tufc?g^ffloft-^«iS:/u 
[0 0 4 3] ;^^V 3 4tC(i. i^^^^m-^ S t!)^ ^ttffi ^ 

i.F^^.^i.x±fiZ^infzmmm^f&^HF t. t;^b 

^mm I H s x^t^^tLf:imm^^f^6^(r)mmm^m^ 

DHF tTb'^^m^th^o L;rc 
a«9T**>*9. -^co?S^(:i^r>^nir5/i^3 8{;iJ: t?tTh) 

yhi&ia&^^^^LF^^iP^Lfc^T^^t-^DP;^^ 
V 3 3(;i1#*ft$n^o fip-^. ;^^y 3 3(:i:7 

[0 0 4 4] y U—J^?^^V 3 3p^(Dm^v''-^:^'^'Ti> 

CRT^<7)^^$gB3 7(c:«^$jx5o ^7t. 
h 3 5 J: t)a^-c5(t#^ j3 ^*;t«^N#;05ig 

[0 0 4 5] [ftH*fcJi#s;&sijififfl:&ffi] :^mmx 

[0 0 4 6] rcO^ft^pi^irfi, ^Jx.«5X5 60B^cD 
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[0 0 4 71 ffij^S^^^)-^^^ 10 

[0 0 4 8] [D 1 4 . i£;iJS»^5^atHco^(:i^.T^M 
mx\^^ 4 X 40 1 6fiC0Eg:^ff^(C^5'S»J^HTV^^o ^ 

[0049lllI16(i. 01 4\Z.ilt6\,^X^m^fhfz.\<:> 

(Dmmi\^-^^^xmm'^n^im-t^^(Dmx^^^ r 

COl^jT'tl. 4o<7)]I,.^.(7){t-§-U-</l'^^n^*ttS (0, 
0) . S (0, n) , S (m, 0) , S (m, n) t^t 

n n 
C ( j. k) = E £ S 
j ==-n k==-n 

So 'f:<Dm^<Dm.^.x<Dm^u-</uc a, k) 

[0 0 5 51 
[|SC2] 

0 

C ( j. k) = 2 S ( J, k. t) / Cn + O 
' t =-n 

[0 0 5 6] SiJ<7):*rffia: LT. wMm^^'<Dmmi 

y\y-M.:^^(b^m$&±xm^mmc'' ^mcxm^^i^x 
iy-Mcm<M^y i^-j>^:^>h^m$A±xmtih\^^i}^^ 
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-So ^:LT. -?:tLt)4o<7>]I^T-ffl4:h.7t2g^ff^;a^m-f 

1) x(n+i) (Dmrn^^A^xi^^t-r^o ^mmx(oi& 
[0 0 5 0] ifscD^yr-f^, ®^ ( i , j ) x<om'^i^ 

T-fcSo 

[0 0 5 1] LF(i,j)= [S(0,0)*(in-i)*(n-j)+S(0,n)*(m 
-i) * j+S (m, 0) *i* (n- j) +S (m, n) *i* j] /m/n (1=0--- 
m, j = 0 ~ n ) 

mmu^^iE:^m<Dm^i'^. (n+i) x(n+i) <omm^^t^ 

[0 0 5 2] 1 7ci. 4-o(Dm.^tmm(omm^7f^'r 
lar-fo-So m,^.\^{c7 X 9 = 6 3m(omm:^^^^ti^o 
-^LT. mi 5 4fcf^iai etc^^tt/c^n^com-^u 

(0. n) CO:^'^ft, nmi^i4\^ti9^(Dmmx(of^i^ 

m^u-</u <ow-^mtimM.s (o. n) <om-^ 

[d 0 5 3] 0iJx.fS. m^-^.^r'^^^L^^rrS (2n+l) x 

(2n + i) (ommcDw^^m.^T^ib^mM^i'^s 

[0 0 5 4] 

[^1] 



( j, k) / (2n+l) « 



( j , k) (1. 
[0 0 5 7] 
[^3] 

0 0 
C C j. k) = Z C-S (j, k, t) / SC- 
t=-n t=-n 

40 [0 0 5 8] ±mcom.'^^x(Dm^- i-^/u(Dmw -^(d 
iB^\y^/\-^mm vtcmmmm-±. m^it^^(Dmt^^^ 

<. 0iJxtf. 0, 2-. 0. 5S?fe(C-|pIMSf-r'5wi: 
[0 0 5 9] ±|BcoftS5^S»j3fifli;^^-eft. ftSSffit^T) 

50 ®^05pi^ffl^^i:Si»a[Jci:t>fT*^tLSo fiP^. *f*M 
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^'^■L-t-r^ (2n + l) X (2n + l) <om$^<Oi& [0 0 6 0] 
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n 

LP ( j. k) = Z 
j=-n 



n 

S LP ( j, k) / (2n+l) * 
k = -n 



[0 0 6 11 i^. ±m<omWHt. f^^'^fV-y^f'T/v^u 
[006 21 E 1 8 tt, MffiF^otf 'i>ffi*SO]I^coiSfeS 

[0 0 6 31 ro^>SiJ;^ffiT'(±. iiiffi^ffi^^J;tlii6:*' 
[ 0 0 6 4 1 Hi 9 (i. E:ftff^roftffi^#JJ£fa<7)i&-g-{i 

Eg^?^ffi7)5^A/T-v^-5:^-^^*-i-iiiT$)5„ z-comz-m 30 

[0 0 6 51 -^rrT-, :$:^?^<Dfl!lOE^SiJiaM(^?^?£t 

00 (A) , (B) J4®ffiSrH:^JgT-5)-fi|Lfcm-&©^J 
^^T^-rHT'fc-So 112 0 (A) ro^sjti, ;*;t^co^/i-5 
H^J^T-^^SI^tbfc^ajT'fct), 02 0 (B) (r>m\±. jE 

[0 0 6 61 H^?l^fcJ:t)®ffiSr5^«d-t-2)r irtditj. 
[006 71 0 2 2 la 1 9 (D$n< E^?^T-fiftE5(r 50 



^(omvhi>o :iro^JT'«. il-^i. (0, 0) . (0. 

n) , (n, 0) , (n, n) 2 ocoH:ft^^^-r 
•5„ =S-]l-^i.T-(^i*^ft-^U'-</W^. S (0. 0) , S 
(0. n) , S (n, 0) , S (n. n) t-T^t, 

[0 0 6 8] (0. 0) t (n. n) Pfl{4. i = j 

LF(i, j) = [S(n,n)-S(0,p)]*i/n + S(0,0) 

ffl^ (0. o) i: (n. 0) mn. j=o-efci9s 

LF(i.0) = [S(n,O)-S(O.O)]*i/n + S(0,0) 

mM (0. 0) t (0. n) ffl{4. i=0T'fc9. 

LF (0, j) = [S (0, n) -S (0, 0) ] * j/n + S (0, 0) 

iie-oT, 11^. (0, 0) , (n, O) , (n. n) <D = 

LF(i, j) = [LF(i, i)-LF(i,0)] *j7i + LF(i,0) 

*fc. TI,^ (0. O) , (O, n) , (n. n) OH^ 

LF(i, j)=[LF(j, j)-LF(0, j)]*i/j + LF(0, j) 
[0 0 6 9] (Si. #]l^.<^i*te1t#U"</K7)*ii6*-f4. 

[0 0 7 0] ±M(on < . *^p>qT-f^ > ^mmx-(DiSim 

[0 0 7 1] 1112 3 (i. S5>S'JifiM*?it;iJ:oT. J^M 
U^/US (i) ^^i-o 12 2 3 (B) ^nmX'S^Pl 
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[0 0 7 2] 1212 3 (A) <73^7:7A- 1 B^^ft-^ 

(B) OMl-*fflA»VNlI^A. B, C, a~l-ecor©{i; 
-<jvt^i^\hhi\,^o ^7:7A-3f4. ms^^m^^^biS: 
[0 0 7 31 ^;iT\ :*:^ig-r'W. h^;^ h^3SI^ 

*;T^fi#D p ( j , k ) fi, 

DP (j, k) =HF (j, k) +/3LF (j. k) + 
-yMF ( j . k) 20 

[0 0 7 4] JEfC. _hteLfcHP&. HEfe. PEife 
[0 0 7 5] 112 4f4. ±fBL)t?*«m-^«!!SCi:7ci — 
[0 0 7 6] *-f, 97!)^e5<^ilB*^m-^SSrp< 

3 2tcfB«ti-€) (SI) „ -tux. ±mm^^m<D 
^^m\^^m-r^ (S2) „ rw^^siifi, «aj;t{fBftifiL 

I^S*:^ft-^S^>^y 3 2;)^e.irci9^ait" (S3) „ :i<D 

rtgBO#Pi*WiSJ^j6tfc^^L F J; 9 40 

S (S4) „ 

[0 0 7 7] ^(Dm. ^mm(r)mmmi^f^^HF^. m 
f^mm^ s A^h^m^^f^.'^ l f css^SLtc ^ <? ^ 

*t>6 (S5) „ ^L-C, i«Jil^^m;*^HF{C-OV^TOt 
(S6) . Wi\K.(iHEmc^iom^ 
M^IHS^^fig-rS (8 7) „ ^(D^^m^lHS^ 
flJfflUT. iiijgjS«Sc^^>HF^^^U'<;Mc^^L.-rm 
^DHFSr**65 (S8) „ ^LT. ^^ft-§-DPSr. 

bfciiSJlJ^l^fiK^^D H F t «;^^-:5lt L/tffiili^^fig 
55-/3 LF<OfPS5^S:tTo-C*«)5 (8 9) „ UT, « 50 
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*^t^DPS:7l^— A^^y 3 3»C15®!L (S 1 0) , 
«*$ga{C«^$-arS (8 1 1) „ 
[0 0 7 8] 

[msoffi^^'iis.?^] 

[mi] feS7u-i^F*9^c*5(t^.®*{4e («**) 

So 

[1112] J!^.?*^{t-^co^P^JlJfeic;4^e,ttttlU/cii5Jli^m 
hrJ^^Air. HP (t>?. h:^^^^:?"^^?^!^? 

[US] ^m^nfc^:^u-^/wi:^ojSft^;T^Lytb;^ 

^i.fc^m'^mmi'i.mw^MX';^^, 

[HIS] iS/gK^fig;^fctt(c:ov^T^^^tL/c:^.^U'< 
^MX'h^o 

[0 7] i&j^gE«6:^^)-o;^%«/T^LfcS*#fccoT'^;^7'u 

[119 1 ^(c^i%Ljt?*:^0iJ (a) <73x•^•:^:7°^— ±tcs 
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(54) [Title of the Invention] Image Signal Processing 
Method 

(57) [Abstract] (Corrected) 
[Problem] 

A method and apparatus for creating contrasty 
display signals by processing image signals acquired 
from Infrared, X-ray or other cameras by a simple 
algorithm is to be provided. 
[Means of solution] 

It has a step of dividing a frame into a plurality 
of polygons and figuring out the signal intensity LF of 
the low frequency component of pixels in the polygons 
from the original image signal intensity S of pixels 
matching the vertexes of the polygons; a step of 
subtracting the signal LF of the low frequency 
component from the original image signals S for each 
pixel and figuring out the signal intensity HF of the 
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high frequency component of the pertinent pixel; a step 
of figuring out with respect to the signal intensities 
HF of frequency components from a histogram indicating 
the frequency of each signal intensity a conversion 
5 function IHS consisting of the integrated value of the 
frequencies by the HE method, for instance, and 
converting the signal intensity HF of the high 
frequency component into a display signal intensity DHF 
on the basis of the conversion function IHS; and a step 
10 of figuring out display signals DP resulting from the 
addition of a signal resulting from the multiplication 
of the signal LF the low frequency component by a 
weighting coefficient p of less than 1 to this DHF. 
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[Claims] 
[Claim 1] 

An image signal processing method for creating 
display signals from original Image signals acquired 
5 from Image pickup means, the Image signal processing 
method being characterized In that it has : 

a step of dividing a frame into a plurality of 
polygons and figuring out the signal Intensity of the 
low frequency component of pixels in the polygons from 
10 the original image signal intensity of pixels matching 
the vertexes of the polygons by interpolatlve 
computation to figure out the signal intensity of the 
low frequency component of the pertinent pixel; 
a step of subtracting the signal of the low 
15 frequency component from the original image signals for 
each of said pixels to figure out the signal intensity 
of the high frequency component of the pertinent pixel; 

a step of adding a signal resulting from the 
multiplication of the signal of said low frequency 
20 component by a weighting coefficient of less than 1 to 
the signal of said high frequency component to figure 
out the display signal of the pertinent pixel; and 

a step of displaying an Image on a display 
apparatus in accordance with the display signal • 
25 [Claim 2] 

An image signal processing method for creating 
display signals from original image signals acquired 
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from Image pickup means, the Image signal processing 
method being characterized in that it has : 

a step of dividing a frame into a plurality of 
polygons and figuring out the signal intensity of the 
5 low frequency component of pixels in the polygons from 
the original image signal intensity of pixels matching 
the vertexes of the polygons by interpolative 
computation to figure out the signal intensity of the 
low frequency component of the pertinent pixel; 

10 a step of subtracting the signal of the low 

frequency component from the original image signals for 
each of said pixels to figure out the signal intensity 
of the high frequency component of the pertinent pixel; 
a step of figuring out with respect to the signal 

15 intensities of the high frequency component from a 
histogrcun indicating the frequency of each signal 
intensity a conversion function consisting of the 
integrated value of the frequencies to each signal 
intensity; 

20 a step of converting the signal intensity of said 

high frequency component into a display signal 
intensity on the basis of the conversion function; 

a step of adding a signal resulting from the 
multiplication of the signal of said low frequency 

25 component by a weighting coefficient of less than 1 to 
the display signal of the converted high frequency 
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component to figure out the display signal of the 
pertinent pixel; and 

a step of displaying an image on a display 
apparatus in accordance with the display signal. 
5 [Claim 3] 

The image signal processing method stated in Claim 
1 or 2, characterized in that: 

when said freune is divided into a plurality, it is 
divided into a plurality of triangles. 
10 [Claim 4] 

The image signal processing method stated in Claim 
1 or 2, characterized in that: 

it has a step of making the original image signal 
intensity of the pixel matching said vertex the average 
15 of the original image signal intensity of pixels around 
the pertinent pixel. 
[Claim 5] 

The image signal processing method stated in Claim 
1 or 2, characterized in that: 
20 it has a step of making the original image signal 

intensity of the pixel matching said vertex the average 
of the original image signal intensity in a plurality 
of frames . 
[Claim 6] 

25 The image signal processing method stated in Claim 

1 or 2 , characterized in that : 
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It has a step of enabling said weighting 
coefficient to be set variably. 
[Claim 7] 

The image signal processing method stated in Claim 
5 2 , characterized in that : 

at the step of figuring out said conversion 
function, the frequency at each signal intensity is 
integrated only to a prescribed meucimum frequency. 
[Claim 8] 

10 The image signal processing method stated in Claim 

7 , characterized in that : 

said maximum frequency is enabled to be set 
variably . 
[Claim 9] 

15 The image signal processing method stated in Claim 

1 or 2, characterized in that: 

at the step of figuring out the signal intensity 
of said high frequency component, 

. with respect to an intermediate frequency 
20 component figured out by subtracting from said original 
image signals the signal of the low frequency component, 
by interpolatlve computation from the vertexes; of other 
smaller polygon than said polygons , a signal of an 
intermediate frequency component of pixels in the other 
25 polygons is created; and 

a signal of the high frequency component of each 
of said pixels is created by subtracting from said 
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original Image signals the signal of said low frequency 
component and the signal of the Intermediate frequency 
component . 
[Claim 10] 

5 An image signal processing apparatus having: 

image pickup means, 

an original image signal memory for recording 
original image signals acquired by the image pickup 
means ; 

10 a image signal processing unit for reading the 

original image signals out of said original image 
signal memory and creating signals for displaying; and 
a display signal memory for recording the display 
signals created by the image signal processing unit, 
15 characterized in that: 

said image signal processing unit has: 
a function to divide a frame into a plurality of 
polygons and figure out the signal intensity of the low 
frequency component of pixels in the polygons from the 
20 original image signal intensity of pixels matching the 
vertexes of the polygons by interpolatlve computation 
to figure out the signal intensity of the low frequency 
component of the pertinent pixel; 

a function to subtract the signal of the low 
25 frequency component from the original image signals for 
each of said pixels to figure out the signal intensity 
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of the high frequency component of the pertinent pixel; 
and 

a function to add a signal resulting from the 
multiplication of the signal of said low frequency 
5 component by a weighting coefficient of less than 1 to 
the signal of said high frequency component to figure 
out the display signal of the pertinent pixel. 
[Claim 11] 

An image signal processing apparatus having: 
10 image pickup means, 

an original image signal memory for recording 
original image signals acquired by the image pickup 
means ; 

a image signal processing unit for reading the 
15 original image signals out of said original image 

signal memory and creating signals for displaying; and 
a display signal memory for recording the display 
signals created by the image signal processing unit, 
characterized in that said image signal processing unit 
20 has: 

a function to divide a frame into a plurality of 
polygons and figure out the signal intensity of the low 
frequency component of pixels in the polygons from the 
original image signal intensity of pixels matching the 
25 vertexes of the polygons by interpolative computation 

to figure out the signal intensity of the low frequency 
component of the pertinent pixel; 
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a function to subtract the signal of the low 
frequency component from the original image signals for 
each of said pixels to figure out the signal intensity 
of the high frequency component of the pertinent pixel; 
5 a function to figure out with respect to the 

signal intensities of the high frequency component from 
a histogram indicating the frequency of each signal 
intensity a conversion function consisting of the 
integrated value of the frequencies to each signal 
10 intensity; 

a function to convert the signal intensity of said 
high frequency component into a display signal 
intensity on the basis of the conversion function; and 

a function to add a signal resulting from the 
15 multiplication of the signal of said low frequency 

component by a weighting coefficient of less than 1 to 
the display signal of the converted high frequency 
component to figure out the display signal of the 
pertinent pixel. 

20 

[Detailed Description of the Invention] 
[0001] 

[Technical Field to which the Invention Belongs] 

The present invention relates to an image signal 
25 processing method and an image signal processing 

apparatus enabling low- contrast image signals from an 



- 9 - 



English translation of JPA1 0-191 1 00 



infrared ray camera. X-ray camera, endoscope or the 
like to be made clearer and displayed. 
[0002] 
[Prior Art] 

5 Image signals picked up by an Infrared ray camera 

In tlie dark or Image signals picked up by an X-ray 
camera by the Roentgen method or the like are extremely 
broad In the dynamic range of the Image pickup element , 
and thus they cannot be represented with sufficient 

10 contrast when displayed as they are on a CRT display 
apparatus having only a normal gradation capability. 
For Instance, an Infrared detection device has a 
gradation scale equivalent to 16 bits. This Is because 
detection signals matching a temperature having an 

15 extremely broad range of Intensity distribution are to 
be extracted. On the other hand, visualized light has 
a gradation scale of only about 8 bits (256 gradations). 
Moreover, a usual CRT display apparatus can express 
only about 25 gradations. 

20 [0003] 

Therefore, If original Image signals detected by 
an Infrared ray camera or the like are simply displayed 
on a display apparatus capable of expressing only a low 
gradation scale, such as a CRT, according to their 
25 Intensities, very low-contrast Images will come out. 
[0004] 
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In this connection, methods to Improve contrast by 
subjecting Image signals to some signal processing 
other have been developed since some time ago. By one 
of these methods for Instance, a histogram indicating 
5 the Indicating the signal intensities of original image 
signals and the frequencies of those intensities in one 
freime is created, 1 is counted when there is at least 
one pixel at each signal level, and the level of the 
original image signals is converted into a display 
10 signal level with the function representing the 

relationship between that signal level and the number 
of counts as the conversion function. This method is 
known as a histogram projection (HP) method. 
[0005] 

15 There also is a histogram equivalence (HE) method 

by which a similar histogram is created, the number of 
pixels at each signal level is simply counted 
(Integrated), and the function representing the 
relationship between that signal level and the number 

20 of counts is used as the conversion function. There 

further is a plateau equivalence (PE) method, which is 
a hybrid between the histogram projection method and 
the histogram equivalence method mentioned above. By 
the plateau (flattened) equivalence method, a similar 

25 histogram is created, the number of pixels at each 

signal level is counted to a certain upper limit, and 
the function representing the relationship between that 
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signal level and the number of counts Is used as the 

conversion function. 

[0006] 

The aforementioned methods are described in, for 
5 instance, SPIE Vol. 2020 Infrared Technology XIX (1993), 
pp. 440-450. 
[0007] 

Every one of these methods is based on an idea of 
allocating a greater number of display levels 

10 (gradations) to a signal higher in pixel frequency out 
of the pixel frequencies of different signals of the 
original image signals pic]ced up by an infrared ray 
camera or the like, which are wide in dynamic range and 
have a large number of gradations. It is thereby 

15 attempted to increase the contrast as much as possible 
within the dyneunic range of the display apparatus . 
[0008] 

[Problems to be Solved by the Invention] 

However, these image signal processing methods are 

20 no different in that eventually pixels of low absolute 
values of original image signal level are displayed 
darlc and, conversely, pixels of high values are 
displayed bright, with the result that images of 
sufficient contrast cannot be displayed on the display 

25 apparatus. 
[0009] 
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Therefore, an object of the present invention is 
to provide an image signal processing method and an 
image signal processing apparatus capable of displaying 
original image signals of a wide dynamic range, 
5 acquired from image pick up means such as an infrared 
ray Ccunera, X-ray camera or the like to be displayed on 
a display apparatus with a narrower dynamic range in 
good contrast . 
[0010] 

10 A further object of the invention is to provide an 

image signal processing method and an image signal 
processing apparatus capable of processing by a simpler 
algorithm and with less frequent accesses to memories. 
[0011] 

15 A further object of the invention is to provide an 

image signal processing method and an image signal 
processing apparatus enabling, so that a wide variety 
of images can be coped with, the observer of the images 
to appropriately select parameters . 

20 [0012] 

[Means of Solving the Problems] 

The objects stated above can be accomplished 
according to the invention by providing an image signal 
processing method for creating display signals from 

25 original image signals acquired from image pickup means, 
the image signal processing method being characterized 
in that it has a step of dividing a frame into a 
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plurality of polygons and figuring out the signal 
intensity of the low frequency component of pixels in 
the polygons from the original image signal intensity 
of pixels matching the vertexes of the polygons by 
5 interpolative computation to figure out the signal 
intensity of the low frequency component of the 
pertinent pixel; a step of subtracting the signal of 
the low frequency component from the original image 
signals for each of the pixels to figure out the signal 

10 intensity of the high frequency component of the 

pertinent pixel; a step of adding a signal resulting 
from the multiplication of the signal of the low 
frequency component by a weighting coefficient of less 
than 1 to the signal of the high frequency component to 

15 figure out the display signal of the pertinent pixel; 
and a step of displaying an image on a display 
apparatus in accordance with the display signal. 
[0013] 

Further, the objects stated above can be 
20 accomplished according to the invention by providing an 
image signal processing method for creating display 
signals from original image signals acquired from image 
pickup means, the image signal processing method being 
characterized in that it has a step of dividing a frame 
25 into a plurality of polygons and figuring out the 
signal intensity of the low frequency component of 
pixels in the polygons from the original image signal 
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intensity of pixels matching the vertexes of the 
polygons by interpolative computation to figure out the 
signal intensity of the low frequency component of the 
pertinent pixel; a step of subtracting the signal of 
5 the low frequency component from the original image 

signals for each of the pixels to figure out the signal 
intensity of the high frequency component of the 
pertinent pixel; a step of figuring out with respect to 
the signal intensities of the high frequency component 

10 from a histogram indicating the frequency of each 

signal intensity a conversion function consisting of 
the integrated value of the frequencies to each signal 
intensity; a step of converting the signal intensity of 
the high frequency component into a display signal 

15 intensity on the basis of the conversion function; a 
step of adding a signal resulting from the 
multiplication of the signal of the low frequency 
component by a weighting coefficient of less than 1 to 
the display signal of the converted high frequency 

20 component to figure out the display signal of the 

pertinent pixel; and a step of displaying an image on a 
display apparatus in accordance with the display signal. 
[0014] 

The objects stated above can also be accomplished 
25 by providing an image signal processing apparatus 

having an image signal processing unit which executes 
the image signal processing methods described above. 
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[0015] 

[Embodiments of the Invention] 

Examples of modes of implement the invention will 

be described below with reference to drawings. However, 
5 these examples of implementation do not limited the 

technical scope of the invention. 

[Principle of the Invention] 

Figure 1 shows an example of graph representing 

the relationship between pixel positions (the 
10 horizontal axis) and the original image signal level S 

(the vertical axis) in a given frame. The spatial 

frequency of the original image signal 10, as indicated 

by 20 in the graph, has a large swell of the signal 

level relative to the pixel position; that large swell 
15 is the low frequency component, and a subtle variation 

in signal level overlapping that swell is the high 

frequency component. 

[0016] 

As stated above, by any of the conventional 
20 methods by which the minimum signal level is matched 
with the minimum display level and the maximum signal 
level is matched the maximum display level, only the 
gradations of the display level are allocated to more 
frequent image signal levels as much as possible, but 
25 displaying on the display apparatus cannot be 
accomplished with sufficient contrast. 
[0017] 
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According to the invention, the low frequency 
component shown in Figure 1 is extracted from the 
spatial frequency of the original image signals, and 
the high frequency component is extracted by removing 
5 that low frequency component from the original image 
signals. And signals resulting from adding the low 
frequency component weighted with less than 1 to the 
high frequency component are made display signals . 
Thus according to the invention, display signals are 
10 generated with emphasis on the high frequency component 
in the spatial frequency of the original image signals 
in order to increase contrast . 
[0018] 

Further according to the invention, a histogram of 
15 this high frequency component is created, and signals 
resulting from adding the appropriately weighted low 
frequency component to the high frequency component 
which has been converted according to a conversion 
function formed by the aforementioned HE method or PE 
20 method are made display signals. In this way, it is 

made possible to arrange signals of the high frequency 
component substantially uniformly within the dynamic 
range of the display signal levels and thereby to 
improve contrast. 
25 [0019] 

As a method of extracting the low frequency 
component from the spatial frequency component of the 
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original image signals, a moving average method is 
generally known, but according to the invention this 
extraction of the low frequency component is 
efficiently accomplished by a simple algorithm. This 
5 point will be described in further detail afterwards • 
[0020] 

Figure 2 shows an example of graph representing 
the histogram H(s) of the high frequency component 
extracted from the spatial frequency of the original 

10 image signals, and conversion functions HS and IHS 

according to the HP (histogram projection) method and 
the HE (histogram equivalence) method. The horizontal 
cixis represents the signal level and the vertical axis, 
the frequency (number) of pixels of each signal level 

15 and the count of the frequency as counted by the HP 
method and the HE method. 
[0021] 

First, H(s) in Figure 2 is the histogram of the 
high frequency component. Thus, since the large swell 

20 of the level of the original image signals is the low 
frequency component as shown in Figure 1 , that low 
frequency component LF is removed from the original 
image signals S, and then the remaining high frequency 
component HF has plus and minus signal levels above and 

25 below the low frequency component. Therefore, the 
histogram H{s) of the high frequency component in 



- 18 - 



English translation of JPA10-191 100 



Figure 2 is distributed to the left and right of the 

signal level 0. 

[0022] 

Then, counting the frequency in this histogram 
5 H(s) by the HP method which requires counting of 1 when 
at least one pixel is present at each signal level 
gives a substantially linear function as represented by 
HS in the graph. As the histogram H(s) has long tails 
left and right, the function of the counts is a linear 
10 function extending over the whole range of signal 
levels . 
[0023] 

On the other hand, counting the frequency in the 
histogrcun H(s) by the HE method by which the number 

15 (frequency) of pixels at each signal level is simply 
counted (integrated) gives a function of simply 
integrating the histogram H(s) as represented by IHS in 
the graph. In this function, the inclination is 
steeper in a higher frequency region and the 

20 inclination is easier in a lower frequency region. 
[0024] 

Then, signal levels S in the range from SLmin to 
SLmax are converted to display levels in the range from 
0 to DLmax with one of these functions HS and IHS as 
25 the conversion function. Thus, the signal level SI in 
the graph, when converted, becomes a display level of 
dl or d2 . It can be understood that, by the HP method. 
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gradations of the display level are allocated only to 
the existing Image signals. It can also be understood 
that, by the conversion function IHS of the HE method, 
more gradations of the display level are allocated to 
5 the region of a higher frequency. 
[0025] 

The present inventor found that contrast often 
failed to be improved by conversion simply according to 
the linear function of the HP method. The reason is 

10 that, since even the histogreun H(s) of the high 

frequency component draws long tails left and right in 
images of the natural world as shown in Figure 2, the 
linear function also extends from the minimum SLmin to 
the maximum SLmax of the signal level, reaching 2(Smax 

15 - Smin) in the worst case. Therefore, by using the 
integrated value of the histogreun as the conversion 
function in accordance with the HE method, contrast can 
be improved by a big leap. 
[0026] 

20 Figure 3 is a histogram showing the aforementioned 

converted display levels and their frequencies. As is 
evident from this graph, by using the integrated value 
IHS according to the HE method as the conversion 
function, the frequencies are substantially uniformized 

25 relative to the display levels. This means that 

contrast can be improved by effectively utilizing the 
limited range of display levels. On the other hand. 
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where the linear function HS according to the HP method 
is used as the conversion function, the frequency is 
higher in the narrow range of display levels as before 
the conversion. 
5 [0027] 

Figures 4, 5, 6 and 7 show as examples for 
supplementary reference an original image (Figure 4), 
an image displayed at the converted display level only 
with respect to the high frequency component (Figure 5), 

10 an image resulting from the addition of a 1/4 weight to 
the low frequency component at the display level of 
that converted high frequency component (Figure 6), and 
an image resulting from the displaying of only the low 
frequency component (Figure 7). 

15 [0028] 

Compared with the example of original image 
(Figure 4), the example of only the high frequency 
component (Figure 5) is more contrasty, with the 
contrast of details emphasized. However, with only the 

20 high frequency component, the right side of the frame, 
which is the brighter part, and the left side of the 
frame, which is the darker part, will become about as 
bright, sometimes looking unnatural. In such a case, 
therefore, by adding a low frequency component 

25 suppressed by appropriately weighting low frequency 

component to the high frequency component (Figure 6) to 
make the right side of the frame generally brighter 
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than the left side, and furthermore the contrast In 

each region Is emphasize. 

[0029] 

Figure 8 Is an excunple of graph showing a 
5 histogram H(s) of the high frequency component 

extracted from the spatial frequency of the original 
Image signals and the conversion function IHS by the PE 
(plateau equivalence) method. In this example, too, 
H(s) Is the histogram of the high frequency component. 

10 And by the plateau equivalence method. Instead of using 
the Integrated value of the histogram HS(s), a 
prescribed value Is given to the maximum N of the 
frequency of each signal level, and that maxlmxim Is 
counted as the frequency of that when there Is a 

15 greater frequency. According to this plateau 

equivalence method, the Integrated value of the 
frequencies shaded In Figure 5 constitutes the 
conversion function IHS. 
[0030] 

20 Therefore, when the peak level of the histogram 

H(s) Is extremely high, extreme emphasis of that region 

can be avoided. 

[0031] 

Where this high frequency component Is to be 
25 converted Into a display level by the plateau 

equivalence method, by appropriately setting the 
maximum frequency N mentioned above, the HE (histogram 
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equivalence) method Is made applicable when N = 
infinity, the PE (plateau equivalence) method is when N 
= M (M is an integer not smaller than 2) or the HP 
(histogram projection) method is when N = 1. 
5 [0032] 

To sum up the principle of the present invention 
so far described, first the high frequency component HF 
and the low frequency component LF are separated from 
the spatial frequency of the original image signals S 
10 having a wide dynamic range., and multiplication of the 
low frequency component by a low weighting coefficient 
P of less than 1 and adding the result to the high 
frequency component HF constitutes the basis of signal 
processing. Thus the display signal DP is as follows. 
15 [0033] 

S = HF + PLF 

DP = HF + pLF 

To add, in this first signal processing, division 
further into to the high frequency component HF, the 

20 intermediate frequency component MF and the low 

frequency component LF and multiplying the intermediate 
frequency component and the low frequency component 
respectively by weighting coefficients y and p of both 
less than 1 would also be acceptable. In that case, 

25 the display signals DP is as follows. 
[0034] 

S = HF + LF + MF 
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DP = HF + pLF + yMF 

A second signal processing Is to create a 
histogram of the high frequency component HF and, by- 
using as the conversion function an Integral function 
5 obtained by counting the frequency of each signal level 
with the maximum frequency being limited to N, the 
original Image signal level Is converted Into a display 
signals level DHF. And the low frequency component 
weighted by p Is added to the signal level of that 
10 converted the high frequency component . The arithmetic 
expression by which the display signals DP (j, k) of 
the pixels (j, k) In that case Is figured out Is as 
follows . 
[0035] 

15 HF (3, k) = S{j, k) - LF (j, k) 

DHF (j, k) = DLmax*IHS(HF(3, k) ) /IHS( SLmax) 
DP(3, k) = (1 - p)*DHF(j, k) + p(LF (J, k) 
To add, as shown In Figure 3 or Figure 8, DLmax Is 
the maximum display level and SLmax, the maximum of the 
20 signal level on the horizontal cixls; hence IHS (SLmax) 
Is the maximum Integrated value of the conversion 
function. 
[0036] 

A third signal processing Is processing to make 
25 possible setting and alteration as appropriate the 

maximum frequency N and the weighting coefficient p or 
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Y in the second signal processing described above. 
Thus, It Is. as shown in the following table. 
[0037] 
[Table 1] 

5 



Number 


Conversion 
Method 


Maximum 
Frequency N 


Weighting 

Coefficient 

fi 


Image 
Example 


1 


HP 


N=l 


B<1 (B=l) 


(d) 


2 


HE 


N>1 (N=50) 
(N=100) 


B<1 (B=l/2) 
(B=l/4) 


(c) 
(b) 


3 


PE 


N=oo 


B<1 (B=0) 


(a) 


4 


No 

Conversion 




B<1 




5 


No 

Conversion 




B=l 


Current 
Image 



And Image excunples (a), (b), (c) and (d) listed In 
the table above are sbown in Figures 9, 10, 11 and 12. 
Number 5 in the foregoing table denote an example of 

10 displaying an original image as it is on a display 
apparatus (Figure 4). Further, number 4 denotes a 
method by which the low frequency component is weighted 
and added the high frequency component without 
performing conversion according to the count function 

15 of the histogram, and corresponds to the first signal 
process described above. This example is not 
illustrated. Further, number 3 denotes a case in which 
the display level DHF converted from the high frequency 
component by the PE conversion method with the maximum 
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frequency N being set to infinity, to which the 
weighted low frequency component is added. Figure 9 
shows an image example (a) in which the display level 
DHF converted from the high frequency component is 
5 displayed with a weighting coefficient p = 0. 
[0038] 

Number 2 shows a case in which the converted 
display level DHF converted by the HE method with the 
maximum frequency N of an integer no smaller than 2 and 
10 the weighted low frequency component PLF are added. 
Figure 10 shows an image (b) wherein p = 1/4, and 
Figure 11, an image exeimple (c) wherein P = 1/2. 
[0039] 

And niomber 1 denotes a case in which the converted 
15 display level DHF converted by the HP method with the 

maximum frequency N of 1 and the weighted low frequency 
component pLF are added. Figure 12 shows in particular 
an image example (d) wherein P = 1. 
[0040] 

20 As described above, the addition of the converted 

display level DHF converted from the high frequency 
component by the count function IHS of the histogram 
and the low frequency component multiplied by the 
weighting coefficient P constitutes the basic signal 

25 processing, and signal processing of numbers 1, 2 and 3 
in the table can be accomplished by appropriately 
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selecting or altering the maximum frequency N and the 

weighting coefficient p. 

[0041] 

Also, where the maximum frequency N = 1 Is set. It 
5 will be equivalent to a case of non- conversion like In 
HS of Figure 3 as described above, and numbers 5 and 1 
In the table above may give substantially the same 
results . 
[0042] 

10 [Image Signal Processing Apparatus] 

Figure 13 Is a schematic block diagram of a signal 
processing apparatus for the Image signals described 
above. Reference numeral 31 denotes, for Instance, an 
Infrared or X-ray camera; analog original Image signals 

15 S that have been picked up are converted Into digital 
signals by an analog- to-dlgltal converter AD and 
temporarily recorded In a memory 32. Reference numeral 
38 denotes a signal processing apparatus, for Instance 
a digital signal processor In which a built -In ROM 

20 storing an operating program Is customized. Where It 
Is a general -purpose processor, the aforementioned 
signal processing Is carried out In accordance with a 
signal processing for arithmetic operation, stored In a 
memory 39. 

25 [0043] 

The low frequency component LF extracted from the 
original Image signals S, the high frequency component 
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HF created by removing the low frequency component LF 
from the Image signals S, the conversion function IHS 
for the frequency count of the histogram, and the 
converted display signals DHF of the high frequency 
5 component converted by that conversion function IHS are 
stored in a memory 34. These arithmetic operations are 
as already described, and all those arithmetic 
operations are performed by the processor 38. And the 
display signals DP resulting from the addition of the 
10 converted display signals DHF and the low frequency 

component LF weighted by P is stored into a memory 33. 

Thus, the memory 33 is a frame memory. 

[0044] 

Display data in the freune memory 33 are converted 
15 by the analog -to -digital converter AD into analog 

values and displayed on a display apparatus 37, such as 
a CRT. Also, the weighting coefficient p, the maximum 
frequency N and so forth are appropriately set with a 
controller 35. The operator, while watching the 
20 display screen, sets these values variably. 
[0045] 

[Curved Surface or Multi-surface Division Approximation 
Method] 

According to the invention, by extracting the low 
25 frequency component of the spatial frequency out of the 
original image signals and subtracting that low 
frequency component from the original image signals. 
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the high frequency component is figured out. In order 
to reproduce the image signals on a display apparatus , 
it is necessary to create display data for 60 frames in 
one second for instance. General arithmetic operation 
5 to extract the low frequency component out of image 
signals is normally accomplished by calculating the 
moving average. 
[0046] 

This moving average is a means by which the 
10 average of, for instance, image signal levels of 25 

pixels within a range of 5 x 5 pixels is given as the 
low frequency component of their central pixel. 
Therefore, in order to compute the low frequency 
component of one pixel, reading should be performed as 
15 many as 25 times out of the memory 32, shown in Figure 
17, in which image signal levels are stored. Moreover, 
accessing the memory 25 times for every memory imposes 
a heavy load on the processor 38, and in the worst case 
it may become impossible to create 60 frames in one 
20 second. 
[0047] 

Therefore, the present invention provides a method 
by which the frequency of accessing the memory to 
create the low frequency component can be extremely 
25 reduced. 
[0048] 
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Figure 14 Is a drawing in which a display frame is 
divided into a plurality of quadrangles to extract the 
low frequency component. In this example, a division 
is made into 4 x 4 = 16 quadrangles* Plotting the 
5 levels of image signals at the vertexes in the 

direction of the Z axis and linking the vertexes by 
straight lines will give, for instance, what is shown 
in Figure 15. As shown in the drawing, straight lines 
linking the grid approximate the low frequency 

10 component LF, micro-signals superposed over the low 
frequency component LF constitute the high frequency 
component. A method by which a division is made with 
quadratic curved surface in this way to figure out the 
high frequency component is known as the curved surface 

15 division approximation method. 
[0049] 

Figure 16 is a drawing for describing 
interpolative computation regarding one of the 
quadratures into which the division is made as shown in 

20 Figure 14. In this example, the signal levels at the 

four vertexes are supposed to be S(0, 0), S(0, n) , S(m, 
0) and S(m, n) . And it is supposed that the quadrature 
surrounded by those four vertexes contain (m+ 1) x (n 
+ 1) pixels. In order to figure out the low frequency 

25 component in each pixel, the signal level of the low 
frequency component of each pixel can be figured out 
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simply by performing interpolative computation from the 

signal levels of the four vertexes . 

[0050] 

In the foregoing example, the signal level at the 
5 pixel ( i , j ) is as follows . 
[0051] 

LF(i, j) = [S(0, 0)*(m -i)*(n - J) + S(0, n)*(m - 
i)*3 + S(m, 0)*i*(n - j) + S{m, n)*i*3]/m/n (I = 0 to 
m, j = 0 to n) 

10 Where the quadrature is a square, it will contain 

(n+1) X (n+1) pixels. 
[0052] 

Figure 17 is a drawing showing the relationships 
between the four vertexes and pixels. Within a vertex, 

15 7x9=63 pixels are contained. And it is preferable, 
with a view to reducing the influences of noise and 
point light sources, to use as the signal level at each 
vertex shown in Figure 15 or Figure 16 the average of 
signal levels of plurality of pixels on and around each 

20 vertex. Thus as shown in Figure 17, for the vertex S(0, 
n), the average of the image signal levels 
(intensities) at the nine shaded pixels is adopted as 
the signal level of the vertex S(0, n) . 
[0053] 

25 The computation formula for figuring out the 

average of (2n + 1) x (2n + 1) pixels on and around a 
vertex is, for example: 
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[0054] 
[Formula 1] 

a j. k) = I I SCj. k) / (2n + if 

j = -n k = -n 

Incidentally, the signal level (intensity) at each 
5 vertex can be computed from the original image signal 
level in a single frame. As another method, it is also 
possible to use moving averages on the time axis from a 
plurality of freunes from the viewpoint of the S/N ratio. 
The signal level C (j, k) at the vertex in that case is 
10 figured out by: 
[0055] 
[Formula 2] 

a3,k) = is^j^k, t)/(n + 1) 

This indicates the average of n+1 frames from a 
15 point of time t = -n till t = 0, though. By adopting 
moving averages on the time axis from a plurality of 
frames, temporal noise can be removed. 
[0056] 

Also, as another method, it is also possible to 
20 achieve extraction by multiplication by the weighting 
coefficient C"* on the time axis from a plurality of 
frames of the original image signals. That weighting 
coefficient is such as one being heavier on the target 
frame and becoming lighter with the distance from the 
25 target frame on the time axis. The signal level C(j, 
k) at the vertex in that case is as follows. 
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[0057] 
[Formula 3] 

aj,k)= 2 c-"a[j.k,t)/ ic-'^ 

In this case again, temporal noise Is reduced and 
5 the S/N ratio Is Improved. 
[0058] 

It Is not necessary to perform the computation of 
the signal level at the vertex and Interpolatlve 
computation using that signal level for every frame 

10 described above, when, for Instance, the variations of 
Images are gradual, but updating every 0.2 to 0.5 
second, for Instance, could well enable real -time 
displaying to be accomplished. In this case, the load 
of computation can be reduced. 

15 [0059] 

By the curved surface division approximation 
method described above. In order to reduce 
discontinuity on the boundary of curved surface 
approximation. It Is preferable to perform smoothing on 

20 the low frequency component LF at each pixel point 
obtained by the approximating calculation. This 
smoothing Is accomplished by, for Instance, computation 
to average the pixels around. Thus, the computation 
formula for averaging the low frequency components LF 

25 of ( 2n+ 1) X ( 2n+ 1) pixels around the target pixel is 
as follows . 
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[Formula 4] 

LP( j, k) = I I LF(j, k) / (2n + if 

[0061] 

To add, the foregoing computation can be processed 
5 at high speed by temporarily storing into, for instance, 
a buffer the low frequency component of each pixel, 
created by the computation process in the digital 
signal processor. 
[0062] 

10 Figure 18 shows a case in which the density of 

vertexes in the central area in the frame is increased 
to enable low to high frequencies to be suppressed, and 
displaying in natural gradations is thereby made 
possible. Thus, there is no need, when making planar 

15 division, to equally divided the inside of the frame. 
[0063] 

By this method of division, the whole frame is 
divided into, for instance, a few parts, and a 
histogram of image signals in each area is created. 

20 And where the distribution range of the histogram is 
broad, as it means that the variation rate of image 
signal levels (intensities) is high, the size of the 
surface into which division is to be made is set 
smaller for that area. Or where the distribution range 

25 of the histogram in the area is narrow, as it means 

that the variation rate of image signal levels is low. 
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the size of the surface into which division is to be 
made is set greater. Thus, in an area where the 
variation rate of image signal levels is high, 
relatively high frequencies among the low frequency 
5 component are also contained. As a result, a low 

frequency component closer to the image signal level 

can be approximated. 

[0064] 

Figure 19 is a drawing showing a case in which 
10 quadratic surfaces are distorted in quadratic curved 
surface division approximation. Surfaces of 
quadratures may be distorted as illustrated here, and 
therefore the above -de scribed method of interpolative 
approximation may result in inaccurate low frequency 
15 components that are approximated. 
[0065] 

In this connection, as another method of surface 
division approximation according to the invention, 
there is a method of dividing the frame by a large 

20 number of triangles. (A) and (B) in Figure 20 show 

cases in which the frame is divided by triangles . The 
example of Figure 20 (A) is a case in which division is 
made by triangles differing in size, and the example of 
Figure 20 (B) , a case in which division is made by 

25 regular triangles, more finely in the central area of 
the frame. Figure 21 is a drawing showing the 
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relationships between pixels and the apexes of 
triangles where division is made by regular triangles. 
[0066] 

Division of a frame by triangles enables the 
5 divided surface to be defined by a plane. This is 

evident from the mathematical theorem that a plane is 
uniquely determined by three points. Therefore, 
division by triangles makes it possible to avoid 
interpolative computation with signal levels of 

10 vertexes on a distorted surface such as the one shown 
in Figure 19. The method by which division is made by 
a large number of planes to accomplish approximation is 
known as the multi- surface division approximation 
method • 

15 [0067] 

Figure 22 is a drawing in which the original image 
signal levels are plotted on the z axis with respect to 
a case in which quadratures give a curved surface as in 
Figure 19. In this case, there are two triangles 

20 within the vertexes (0, 0), (0, n), (n, 0) and (n, n). 
The image signal levels at the vertexes being 
represented by S(0, 0), S(0, n), S(n, 0) and S(n, n), 
the signal levels of the internal pixels can be figured 
put by the following interpolative computation. And 

25 the signal levels thereby figured out are the 

approximated signal levels of the low frequency 
component . 
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[0068] 

Between the vertexes (0, 0) and (n, n) i = j holds, 

LF (i, j) = [S{n - n) -S(0, 0)]*i/n + S(0, 0); 
between the vertexes (0, 0) and (n, 0) j = 0 holds, 
5 LF (1, 0) = [S(n, 0) - S(0, 0)]*i/n + S(0, 0); 

between the vertexes (0, 0) and (0 - n) i = 0 
holds , 

LF (0, j) = [S(0, n) - S(0, 0)]*J/n + S(0, 0). 
Therefore, for the pixels In the triangle of the 
10 vertexes (0, 0), (n, 0) and (n, n) , 

LF (1, j) = [LF (1, 1) - LF (1, 0)]*3/i + LF (i, 
0) holds. 

On the other hand, for the pixels in the triangle 
of the vertexes (0, 0), (0, n) and (n, n) , 
15 LF (i, j) = [LF (3, 3) - LF (0, D)]*i/j + LF (0, 

3 ) holds • 

Therefore, by performing the five computations 
above, the signal levels of the pixels can be figured 
out by interpolative computation. 
20 [0069] 

Incidentally, as regards the method of figuring 
out the image signal levels at the vertexes, as 
described with respect to curved surface division 
approximation using quadratures, it can be figured out 
25 in a single frame, by calculating moving averages in a 
plurality of freunes on the time axis, by multiplying by 
a weighting coefficient or otherwise. 
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[0070] 

As described, according to the invention, for the 
purpose of figuring out the signal level of the low 
frequency component at each pixel, a signal level 
5 cleared of the high frequency component can be 

automatically figured out by dividing the inside of the 
frame into a plurality of surfaces (curved surfaces or 
plane surfaces) and by obtaining the signal levels of 
pixels from the original image signal levels at the 

10 vertexes by interpolation. Therefore, it is not 

necessary to read the original image signal level of 
every pixel out of the memory 32 . By perf oarming the 
aforementioned interpolative computation from the 
original image signal level at the vertex, the low 

15 frequency component can be automatically figured out, 
resulting in a reduced load of computation. 
[0071] 

Figure 23 comprises drawings illustrating a method 
of extracting the low frequency component and the 

20 intermediate frequency component from the spatial 

frequency of the original image signal level by the 
surface division approximation method. Figure 23 (A) 
shows the position i on the horizontal axis and the 
signal level S{i) of each component on the vertical 

25 axis. Figure 23 (B) shows a plane ABC divided by 
triangles . 
[0072] 
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Graph A-1 of Figure 23 (A) shows an Image signal 
together with Its low frequency component and 
Intermediate frequency component. By figuring out the 
signal level of the Internal pixels from the signal 
5 level S(i) at the vertexes A, B and C out of this image 
signal level by interpolation, the signal level of the 
low frequency component can be obtained. Graph A- 2 
shows image signals resulting from the removal of the 
low frequency component mentioned above from the 

10 original image signal level. Further, by figuring out 
the signal level of the internal pixels by 
interpolation on the basis of these image signals 
cleared of the low frequency component at the finer 
vertexes A, B, C and a through 1 in Figure 23 (B), the 

15 signal level of the intermediate frequency component 

can be obtained. Graph A- 3 shows a signal of the high 
frequency component resulting from the removal of 
signals of the low frequency component and the 
intermediate frequency component from the original 

20 image signals. 
[00731 

In this connection according to the invention, by 
multiplying the low frequency component and the 
intermediate frequency component by any weighting 
25 coefficients p and y of less than 1 and adding the 
weighted components to the high frequency component 
with a view of emphasizing contrast, the display signal 
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level is computed. Therefore, the display signals DP 
(3, k) in this case can be figured out by: 

DP(3, k) = HF(j, k) + pLF (j, k) + YMF(j, k) 
[0074] 

5 Further by converting the image signal levels into 

the dynamic range of the display signal levels with 
respect to the high frequency component by the 
aforementioned HP method, HE method or PE method (see 
the table above), contrast can be increased. This 
10 point was already described. 
[0075] 

Figure 24 shows a flow chart of the image signal 
processing described above. The image signal 
processing method according to the invention will be 
15 Slimmed up with reference to this flow chart. In this 
instance, the low frequency component and the high 
frequency component are used. 
[0076] 

First, the original image signals S from an image 
20 pickup C€unera is recorded in the memory 32 (SI). Then, 
the whole frame is divided into a large number of 
triangles (S2). It is preferable for this division to 
be finer in triangle size correspondingly to the 
greatness of the aforementioned variation rate of the 
25 signal level for instance. And the original image 

signals S of the vertex of the surface of each triangle 
are read out of the memory 32 (S3). This reading need 
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not be done about every pixel but Is sufficient If the 
pixels matching the vertex are covered. And the low 
frequency component LF of each internal pixel Is 
figured out by interpolatlve computation from the 
5 original Image signal level of that vertex (S4) . 
[0077] 

After that, the high frequency component HF of 
each pixel is figured out by computation of subtracting 
the low frequency component LF from the original image 

10 signal S (S5). And a histogram regarding the high 

frequency component HF is created (S6) to create the 
conversion function IHS by the HE method, for Instance 
(S7). This conversion function IHS is used to convert 
the high frequency component HF into a display level 

15 and figure out a signal DHF (S8). Then, a display 

signal DP is figured out by computing the sxim of the 
converted high frequency component DHF and the weighted 
low frequency component PLF (S9). And the display 
signal DP is recorded in the frame memory 33 (SIO), and 

20 caused to be displayed on a display apparatus (Sll) . 
[0078] 

[Advantages of the Invention] 

As hitherto described, according to the present 
invention, it is possible to create display signals 
25 that can be displayed in high contrast on a display 
apparatus of a narrow dyneunic range out of original 
image signals of a wide dynamic range, picked up by an 
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Infrared or X-ray camera. Furthermore, by using multi- 
surface or curved surface division approximation method 
for extracting the low frequency component, the load of 
that extractive computation can be reduced, and 
5 computation for display signal creation for displaying 
image signals can be sufficiently accomplished a simple 
hardware configuration. 

[Brief Description of the Drawings] 

10 [Figure 1] 

This is a graph representing the relationship 
between pixel positions (the horizontal axis) and the 
original image signal level (the vertical axis) in a 
given frame. 

15 [Figure 2] 

This is a graph representing the histogram of the 
high frequency component extracted from the spatial 
frequency of the original image signals, and conversion 
functions according to the HP (histogram projection) 

20 method and the HE (histogram equivalence) method. 
[Figure 3] 

This is a histogram showing the converted display 
levels and their frequencies . 
[Figure 4] 

25 This is a substitute photograph for a drawing of 

an image reproducing on a display an example of 
original image as one example. 
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[Figure 5] 

This is a substitute photograph for a drawing of 
an image reproducing on a display at the converted 
display level only with respect to the high frequency 
5 component . 
[Figure 6] 

This is a substitute photograph for a drawing of 
an image reproducing on a display resulting from the 
addition of the low frequency component weighted by 1/4 
10 to the display level of the converted high frequency 
component of Figure 5 . 
[Figure 7] 

This is a substitute photograph for a drawing of 
an image reproducing on a display showing an image 
15 displaying only the low frequency component. 
[Figure 8] 

This is a graph showing a histogram of the high 
frequency component extracted from the spatial 
frequency of the original image signals and the 
20 conversion function by the PE (plateau equivalence) 
method • 
[Figure 9] 

This is a substitute photograph for a drawing of 
an image reproducing an image example (a) listed in the 
25 table on a display. 
[Figure 10] 
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This is a substitute photograph for a drawing of 
an image reproducing an image example (b) listed in the 
table on a display. 
[Figure 11] 

5 This is a substitute photograph for a drawing of 

an image reproducing an image example (c) listed in the 
table on a display. 
[Figure 12] 

This is a substitute photograph for a drawing of 
10 an image reproducing an image example (d) listed in the 
table on a display. 
[Figure 13] 

This is a schematic block diagram of a signal 
processing apparatus for image signals. 
15 [Figure 14] 

This is a drawing of a case in which a display 
frame is divided into a plurality of quadrangles to 
extract the low frequency component . 
[Figure 15] 

20 This is a schematic diagram in which the levels of 

image signals at thie vertexes are plotted in the 
direction of the Z axis with respect to the quadratures 
into which the division is made. 
[Figure 16] 

25 This is a drawing for describing interpolative 

computation regarding one of the quadratures into which 
the division is made. 
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[Figure 17] 

This is a drawing showing the relationships 
between four vertexes and pixels. 
[Figure 18] 

5 This is a drawing showing a case in which the 

density of vertexes in the central area in the frame is 
increased to enable frequencies up to a higher range to 
be suppressed and displaying to be accomplished in 
natural gradations. 
10 [Figure 19] 

This is a drawing showing a case in which 
quadratic surfaces are distorted- 
[Figure 20] 

This comprises drawings showing cases in which the 
15 frame is divided by triangles. 
[Figure 21] 

This is a drawing showing the relationships 
between pixels and the apexes of triangles where 
division is made by regular triangles. 
20 [Figure 22] 

This is a drawing in which the original image 
signal levels are applied on the z axis with respect to 
a case in which the surface is distorted. 
[Figure 23] 

25 This comprises drawings illustrating relationships 

among the high frequency component, the intermediate 
frequency component and the low frequency component . 
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[Figure 24] 

This shows a flow chart of image signal processing 
image signals, 

[Description of Reference Numerals] 

32 Original image signal memory 

33 Display signal memory 

38 Image signal processing unit 

S Original image signal 

LF Low frequency component 

MF Intermediate frequency component 

HF High frequency component 

IHS Conversion function 

DHF Signal of converted high frequency component 
DP Display signal 
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[Figure 1] . 
#1 Original image signal level S 
#2 Low frequency component (LF) 
#3 Pixel position 

5 

[Figure 2] 
#1 Frequency (H) 
#2 IHS (integrated, HE method) 
#3 HS (linear, HP method) 
10 #4 Count 

#5 Display level (DHF) 

#6 High frequency component (S) 

[Figure 3] 
15 #1 Frequency 

#2 IHS (integrated, HE method) 
#3 HS (linear, HP method) 
#4 Display level (DHF) 

20 [Figure 8] 

#1 Frequency 
#2 Maximum frequency N 
#3 Display level (DHF) 
#4 Count 

25 #5 Signal level of high frequency component (S) 
[Figure 13] 
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31 


Camera 


32 


Memory S(J, K) 


33 


Memory DP(J, K) 


34 


Memory 


35 


Controller 


37 


Display apparatus 


38 


Processor 


39 


Signal processing program 



10 [Figure 15] 

#1 HF High frequency component 
#2 LF Low frequency component 
#3 (To Figure 10) 

15 [Figure 21] 
#1 Pixel 

[Figure 23] 

#1 Level II (intermediate frequency component) 

20 #2 Level I (low frequency component) 

#3 Image signal 

#4 Level III (high frequency component) 

#5 Position (i) 

#6 Level I 

25 #7 Level II 

[Figure 24] 
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#1 Flow chart signal processing until displaying of 
one frame 
#2 Start 

51 Original Image signals S from Image pickup ceunera 
5 recorded in memory 

52 Whole frame divided into large number of surfaces 

53 Original image signal S of vertex of each surface 
read out of memory 

54 Low frequency component LF of each pixel within 
10 figured out by interpolatlve computation from original 

image signal level S of vertex 

55 High frequency component HF of each pixel computed 
(HF = S - LF) 

56 Histogreun created regarding high frequency 
15 component HF 

57 Conversion function IHS created by HE method 

58 High frequency component HF converted into display 
level following conversion function IHS (DHF) 

59 Display signal DP figured out as sum of converted 
20 high frequency component DHF and weighted low frequency 

component BLF 

510 Display signal DP recorded in frame memory 33 

511 Displayed 
#3 End 
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